OPEN 3 ACCESS Freely available online 



•0-PLOS I o-^E 



Effects of an Internet-Based Cognitive Behavioral (Wt\ 
Therapy (iCBT) Program in Manga Format on Improving crossMark 
Subthreshold Depressive Symptoms among Healthy 
Workers: A Randomized Controlled Trial 

Kotaro lnnannura\ Norito Kawakami^% Toshi A. Furukawa^, Yutaka Matsuyama^, Akihito Shimazu\ 
Rino Unnanodan^, Sonoko Kawakami^ Kiyoto Kasai^ 

1 Department of Mental Health, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan, 2 Departments of Health Promotion and Human Behavior and of 
Clinical Epidemiology, Graduate School of Medicine/School of Public Health, Kyoto University, Kyoto, Japan, 3 Department of Blostatistics, Graduate School of Medicine, 
The University of Tokyo, Tokyo, Japan, 4 Kyoto Office, Health Wave Co., Ltd., Kyoto, Japan, 5 Nippon University College of the Arts, Tokyo, Japan, 6 Department of 
Neuropsychiatry, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan 



Abstract 

Objective: Jhe purpose of this study was to develop a new Internet-based computerized cognitive behavior therapy (ICBT) 
progrann in Manga format, the Japanese cartoon, for workers and to examine the effects of the iCBT program on improving 
subthreshold depression using a randomized controlled trial (RCT) design among workers employed in private companies in 
Japan. 

Method: All workers in a company (n = 290) and all workers in three departments (n = 1 ,500) at the headquarters of another 
large company were recruited by an invitation e-mail. Participants who fulfilled the inclusion criteria were randomly 
allocated to intervention or control groups (N = 381 for each group). A six-week, six-lesson iCBT program using Manga 
(Japanese comic) story was developed. The program included several CBT skills: self-monitoring, cognitive restructuring, 
assertiveness, problem solving, and relaxation. The intervention group studied the iCBT program at a frequency of one 
lesson per week. Depression (Beck Depression Inventory II; BDI-II) was assessed as a primary outcome at baseline, and three- 
and six-month follow-ups for both intervention and control groups were performed. 

Results: Jhe iCBT program showed a significant intervention effect on BDI-II (t=-1.99, p<0.05) with small effect sizes 
(Cohen's d: -0.16, 95% Confidence Interval: -0.32 to 0.00, at six-month follow-up). 

Conclusions: The present study first demonstrated that a computerized cognitive behavior therapy delivered via the 
Internet was effective in improving depression in the general working population. It seems critical to improve program 
involvement of participants in order to enhance the effect size of an iCBT program. 
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Introduction 

Occupational stress has been considered a major risk factor for a 
wide range of health outcomes [1,2]. To reduce work-related stress 
and its negative effect on health among workers, more attention 
has been paid to the primary prevention strategy. Among other 
measures, stress management interventions (SMI) have recently 
become frequendy applied in the workplace [3]. A growing body 
of literature has shown that SMIs based on cognitive behavioral 
therapy (CBT) [4,5] and relaxation therapy [6] are effective in 
reducing work-related stress and improving depression and anxiety 
among workers. A meta-analysis reported that the estimated 
effects of CBT and relaxation therapy were Cohen's d = 0.68 and 
0.35, respectively [7]. Another meta-analysis reported that the 
estimated effects of CBT and relaxation therapy were Cohen's 
d= 1.16 and 0.50, respectively [6]. However, the implementation 
of these interventions was still limited, because such a program 
requires professionals well trained in CBT [8-10]. In addition, 
even if a service is provided, the time, cost, and stigma related to 
mental health treatment could serve as barriers to access to the 
effective treatment [11]. 

An innovative way to deliver CBT-based treatment widely is 
with a computerized CBT (CCBT). CCBT programs can teach 
information and techniques based on the same CBT principles as 
face-to-face CBT programs do, with a highly structured format 
comprising educational lessons, homework assignments, and 
supplementary resources [12]. Spurgeon and Wright (2010) 
claimed that there were three major platforms on which to deliver 
the CCBT programs: 1) multimedia computer programs, 2) virtual 
reality programs, and 3) Smartphone or handheld device 
applications. Some programs are delivered in a clinic, and others 
are accessed at home or through other venues, such as the Internet 
[13]. The mode of application is an Internet-based cognitive 
behavioral therapy (iCBT): i.e., a CCBT delivered via the 
Internet. In addition to the features of CCBT, iCBT has a special 
feature of high anonymity and high accessibility. In terms of 
anonymity, iCBT is suitable for addressing psychological problems 
because it can enable users to avoid the stigma incurred by seeing 
a therapist [14]. In terms of accessibility, iCBT provides users with 
the opportunity to obtain treatment at any time and at any place, 
such as in the workplace or at home, and study the content as 
much as they want [15]. The level of therapist involvement in 
iCBT can vary among programs; they could provide no assistance, 
minimal therapist contact by email or telephone, or a contact 
similar to face-to-face therapy [15]. However, a complete online 
iCBT may have merit since it can provide a viable alternate 
mental health resource for people who have geographical, 
physical, psychological, and/or financial barriers to seeking 
traditional, face-to-face care [11]. 

Previous iCBT programs have been shown to have a significant 
positive treatment effect on depression and anxiety mosdy in the 
clinical setting. A meta-analysis of RCT reported that iCBT can 
improve depressive symptoms of patients who have major 
depressive disorder (Hedges' g = 0.56-0.99) and anxiety disorders 
(Hedges' g values were 0.92 for social phobia, 0.83 for panic 
disorder, and 1.12 for generalized anxiety disorder) more 
effectively compared with TAU or waiting list [16]. The treatment 
effects of iCBT varied by the extent of therapist involvement. 
Another meta-analysis reported that the effect size (about 0.6 in 
Cohen's d on average) of iCBT with therapist support was greater 



than the effect size (about 0.25) of self-guided program without 
therapist support [15,17]. However, these self-guided-only pro- 
grams showed small to medium effects, and thus a self-guided 
iCBT program is still considered to be helpful for people who have 
mUd to moderate symptoms but cannot (or do not wish to) see a 
clinician [12]. Most critical problem within self-guided programs 
that might have resulted in a smaller effect was high dropout rates 
[12]. 

Despite a number of benefits of using CCBT and iCBT, the 
application of these programs in the workplace setting has been 
limited. Grime (2004) conducted a randomized controlled trial 
(RCT) to evaluate the effect of an eight-week CCBT program to 
improve emotional distress among employees who had recendy 
experienced stress-related absenteeism. A month before the end of 
the intervention, the depression and anxiety among the partici- 
pants in the intervention group improved significantly compared 
to that of the TAU group [18]. Grime (2004) also reported reasons 
for non-participation [18]. Non-participation in this study was 
common and related to a number of barriers, such as access 
problems, preference for other treatments (especially face-to-face 
counseling), time commitment, skepticism about the intervention, 
and employer connection. An online or Internet-based CCBT 
program might be effective in reducing concerns about travel and 
time off work, confidentiality, and connection with the employer; 
thus it appears to improve workers' participation more than a 
CCBT program. However, no iCBT program is available that 
would target specifically the general working population, the 
effectiveness of which would be tested with an RCT. 

The purpose of this study was to develop a new six-week iCBT 
program for workers in Japan and to examine the effects of the 
iCBT program on improving the symptoms of depression at three- 
and six-month foUow-ups using a randomized controlled trial 
design among workers employed in private companies in Japan. In 
the iCBT program, we applied a "Manga" (the Japanese cartoon 
or comic story) format, that is now frequendy used to communi- 
cate medical information in Japan[19], expecting participants' 
greater commitment to and better understanding of the contents of 
the program with using this communicative medium[20,21]. 

Methods 

Trial design 

The study was a randomized controlled trial. The allocation 
ratio of the intervention group to the control group was 1 to 1. The 
study protocol was registered at the UMIN Clinical Trials Registry 
(UMIN-CTR) (ID = UMIN000006210). The protocol for this trial 
and supporting CONSORT checkhst are available as supporting 
information; see Checklist SI, Protocol SI and Protocol S2. 

Participants 

All workers in company A (N = 290) and all workers who 
belonged to three selected departments (N = about 1,500) at the 
headquarter of company B (the total employee size, c.a. 11,000) 
were recruited by an invitation e-mail. Both companies developed 
information technology systems and related services as their 
products. Those who were interested in participating in the study 
were asked to go to a research website to obtain full explanation of 
the study's aim and procedure and to input their baseline 
information if they agreed to participate. The inclusion criteria 



PLOS ONE I www.plosone.org 



2 



May 2014 | Volume 9 | Issue 5 | e97167 



Internet-Based CBT among Workers 



stated that participants could 1) not be diagnosed with a major 
depressive disorder in the past month (using the web-version of the 
WHO-Composite International Diagnostic Interview version 3.0 
(WHO-CIDI 3.0) [22], 2) not be diagnosed with lifetime bipolar 
disorder (WHO-CIDI 3.0), 3) not have taken 15 sick leave days or 
more in total due to their own health problems during the past 
three months, and 4) not have received medical treatment for 
mental health problems during the past month. 

Intervention 

Participants who were allocated to the intervention group 
studied the new iCBT program called the Internet CBT program; 
Useful mental health solutions series for business. The program was a six- 
week web-based training course to provide stress management 
skills. This program was structured into six lessons, with one lesson 
given per week. Learning one lesson required about 30 minutes, 
including homework. This program can be used anywhere the 
Internet is available. 

One of the unique features of the program was that the training 
was provided along with a Manga Japanese comic) story of a 
psychologist and a client worker to facilitate the understanding of 
the participants (Figure 1). Several merits of using a comic story 
and comic characters in education have been acknowledged 
through research. First, these materials help motivate individuals, 
and high motivation is useful to keep participants in the program 
[23]. Second, they facilitate easy learning. A program with text 
combined with comic stories would be easier for a learner to 
understand compared to a text-only program [23,24]. Third, 
comic stories foster learners' interest in the program [24]. These 
merits might be applicable to education in the workplace, because 
most Japanese people of working age are familiar with comics. 

In terms of the CBT components of the program, included were 
self-monitoring skills, cognitive restructuring skills, assertiveness, 
problem-solving skills, and relaxation skills. At the end of each 
lesson, participants were asked to submit homework to facilitate 
their understanding, although it was voluntary. Participants who 
submitted their homework received feedback from trained staff 
(clinical psychologists). 

The iCBT program included self-monitoring skills (in lesson 2), 
cognitive restructuring skills (in lessons 3 and 4), assertiveness (in 
lesson 5), problem-solving skills (in lesson 6), and relaxation skills 
(in lesson 4). In this study, a cognitive restructuring method was 
adopted as the primary outcome and main cognitive approach, 
and this has been shown to be effective in reducing depression 
[25]. Assertiveness and problem-solving training as well as 
relaxation skills were chosen as supplementary behavioral 
approaches to enhance the effect of the program. 

Intervention group 

Participants completed six weekly lessons and homework within 
the iCBT program. They were allowed to complete the six lessons 
within 10 weeks after the baseline* survey. Participants were 
reminded by e-mail to complete each lesson and/or to submit 
homework if they had not already done so. Reminders were sent 
from the research office to the participants every Monday. 

Control group 

Participants in the control group received an e-mail message 
once a month titled "Useful information for stress management." 
Each e-mail message consisted of about 500 words in Japanese and 
included stress management tips. The contents were as follows: 1) 
How to have a good sleep, 2) The effects of your diet and ingesting 
alcohol for stress, 3) How to have a good holiday, 4) Relaxing by 
listening to music and taking a bath, and 5) The effects of exercise 



on strc-ss. Participants were also able to use an internal employee 
assistance program service. In addition, an e-learning program on 
stress and stress management was provided to all employees at 
company B. This e-learning program contained only a few 
descriptions of CB-based approaches. 

Outcomes measures 

Beck Depression Inventory II (BDI-II). The BDI-II is a 

21 -item self-report inventory that measures depressive symptoms 
such as sadness, pessimism, suicidal thoughts or wishes, tiredness 
or fatigue, loss of energy, and loss of pleasure, among others 
[26,27]. Each item is scored on a scale ranging from 0 to 3, with a 
higher score indicating more serious depressive symptoms. 

Kessler's psychological distress scale (K6). Psychological 
distress was measured with the Japanese version of the K6 scale 
[28,29]. K6 consists of six items assessing the frequency with which 
respondents have experienced symptoms of p.sychological distress 
during the past 30 days. The response options range from 0 (none 
of the time) to 4 (all of the time). The internal reliability and 
validity found in previous studies are acceptable [28]. 

Japanese version of Dysfunctional Attitude Scale 24 
(DAS24-J). The 24-item Dysfunctional Attitude Scale (DAS- 
24) is a short v(-rsi()n of the Dysfunctional Attitude Scale, which is 
a self-report inventory measuring depressogenic schemata. Each 
item is scored on a scale ranging from one (totally disagree) to 
seven (totally agree), with a higher score indicating a more 
dysfunctional attitude [30]. The Japanese version has been 
developed and tested, and its reliability and validity have been 
established [31]. 

Improvement of knowledge and self-efficacy. Respondents 
were asked to rate their improvement of knowledge and self-efficacy 
regarding five components of the iCBT program (Stress manage- 
ment. Cognitive restructuring, Assertive communication, Problem- 
soKing, Relaxation training). Knowledge improvement was assessed 
by asking participants, "How much knowledge do you have 
about..." and self-efficacy improvement was assessed by asking 
respondents "How confident are you that you can do. . . ." Both items 
were scored on 5-point scale ranging from 0 (none) to 4 (enough). 

Demographic characteristics. Demographic data, such as 
age, gender, marital status, occupation, education, chronic disease, 
and overtime hours during the past month were also collected. 

Sample size calculation 

A systematic review of psychological treatments, mostiy CBT 
for .subthreshold depression, yielded a Cohen's d of 0.42 (95%CI: 
0.23 to 0.60) at post-test [32]. On the other hand, it was reported 
that the effect of preventive interventions on the incidence of 
major depressive disorders was smaller in the universal setting than 
that in the selective or indicated setting [33]. In order to detect an 
effect size of 0.30 or greater at an alpha error rate of 0.05 and a 
beta error rate of 0.10, the estimated sample size was 235 
participants per arm. With the anticipated dropout rate of 30%, 
the necessary sample size was 336 participants per arm. The 
statistical power analysis was conducted using the G*Power 3 
program [34,35]. 

Randomization 

Participants who fulfilled the inclusion criteria were randomly 
allocated to inter\'ention or control groups (N = 38 1 for each 
group). Stratffied permuted-block randomization was conducted. 
Participants were stratified into four strata according to two factors: 
K6 score (5 or greater or less than 5) at baseline survey and company 
(A or B) to which they belonged. A stratified permuted-block 
random table was generated by an independent biostatistician. 
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Figure 1. A screen shot of an Internet-based cognitive behavioral therapy (iCBT) program developed in "Manga" (the Japanese 
cartoon or comic story) format in this study. 

doi:1 0.1 371 /journal.pone.00971 67.g001 



Enrollment was conducted by a clinical research coordinator, and 
assignment was conducted by an independent research assistant. 
The stratified permuted-block random table was password-protect- 
ed and blinded to the researcher. Only the research assistant had 
access to it during the work of random allocation. 

Statistical analyses 

A mixed-model for repeated measures conditional growth 
model analyses were conducted using a group (intervention and 
control) * time (baseline, three-month, and six-month foUow-up) 
interaction as an indicator of intervention effect. Intention-to-treat 
analysis (ITT) was conducted. The Linear Mixed Model in the 
PASW Statistics 18.0 was used. The Number Needed to Treat 
(NNT) to reduce depressive symptoms or psychological distress to 
achieve one improvement from subthreshold depression was 
calculated. Referencing the cutoff scores of BDI-II and K6 of 
previous studies [26,36], the improvement was defined to change 
the scores from 14 or higher to 13 or less on the BDI-II or to 
change the scores from 5 or higher to 4 or less on the K6. Effect 
sizes and 95% Confidence Interval (95% CI) were calculated using 
Cohen's d among those who completed the questionnaire at 
baseline and at a follow-up. The values of 0.2, 0.5, and 0.8 are 
generally interpreted as being suggestive of small, medium, and 
large effects, respectively [37]. Subgroup analyses were conducted 
separately among respondents who had high (5 or higher score of 
K6) and low (4 or less score) scores at baseline, with the cutoff 
score for K6 selected based on a previous report, which suggested 
that 4/5 is the optimal cutoff point for K6 in terms of 
discriminating community residents and patients with mood and 
anxiety disorders [36] . 

Ethics 

The Research Ethics Review Board of Graduate School of 
Medicine, the University of Tokyo (No. 3083) approved the study 
procedures. We prepared a website which contained fuU 
explanation of the study. Before the baseline survey, participants 
were invited to read the explanation on the website, and asked to 
click an "agree" button to show their consent to participate in the 
study; then they proceeded to the basehne questionnaire page. 



Written consent was not required by the National Ethical 
Guidelines for Epidemiologic Research, Japan; the Research 
Ethics Review Board of Graduate School of Medicine, the 
University of Tokyo approved this procedure to obtain partici- 
pant's consent. 

Changes to the protocol 

One major change made to the protocol is the inclusion criteria. 
Originally it was planned that the participants who scored 5 or 
more for the K6 on the baseline survey would be allocated. Before 
the commencement of this study, this criterion was canceled due to 
the anticipation of a low participation rate. With this, sample size 
was recalculated. Another change made to the protocol is the 
method of statistical analysis. Originally the per-protocol analysis 
was planned, but the ITT analysis was conducted in the present 
study due to the expectation to be conservative in superiority trials. 
In addition, NNT was calculated due to the description of the 
difference between a treatment and a control in achieving a 
particular outcome. 

Results 

Participant flowchart 

Participant flowchart is shown in Figure 2. Participants were 
recruited from 2 companies (N= 1790), and 850 (47.5%) of them 
completed a baseline survey. Out of those, 88 had to be excluded 
because 20 did not fulfill criterion #1 (not diagnosed as major 
depressive disorder in the past 1 month), and 2 did not fulfdl 
criterion #2 (not diagnosed as lifetime bipolar disorder), which 
were assessed using the web-version of WHO-CIDI 3.0. An 
additional 35 did not fulfill criterion ^3 (not having taken 15 or 
more sick leave days in total due to their own health problems 
during the past 3 months), and 42 did not fulfill criterion ^4 (not 
having gone to the hospital during the past 1 month). Seven of 
them did not fulfill criteria # 1 and #4, and four of them did not 
fulfill criteria ^3 and ^4. The remaining 762 participants were 
randomly allocated to an intervention or control group (N = 38 1 
for each). 
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Baseline survey 

Participants were recruited from two companies (N=1790); 
850 (47.5%) participated in a baseline survey. 



Excluded (N=88') 

1. Having IVIDD during past 1 montti. (N=20) 

2. Having lifetime bipolar disorder. (N=2) 

3. Having sick leave days of 15 days or more in total due to 
own health problems during the past 3 month. (N=35) 

4. Going to hospital during the past 1 month. (N=42) 

*7 cases fulfilled the criteria 1 and 4, 4 cases fulfilled the 
criteria 3 and 4. 



Random assignment 

N=762 



Assigned to intervention 
N=381 



At 3 month follow-up 

Completed follow-up 
N=270 (70.9%) 



At 6 month follow-up 

Completed follow-up 
N=272 (71.4%) 



Assigned to control 
N=381 



At 3 month follow-up 

Completed follow-up 
N=336 (88.2%) 



At 6 month follow-up 

Completed follow-up 
N=320 (84.0%) 



Figure 2. Participant flowchart. 

dol:1 0.1 371/journal.pone.0097167.g002 



At 3-month follow-up, 270 {70.9"/o) participants in the 
intervention group and 33(i (HH.2"/«) in the control group 
completed the follow-up survey. At the 6-month follow-up, 272 
(71.4%) participants in the intervention group and 320 (84.0'M)) in 
the control group completed the follow-up survey. At each follow- 
up, the response rate of the control group was higher compared to 
that of the intervention group. Reasons for dropping out were not 
assessed in this study. 

Recruitment 

Recruitment and the basehne survey were conducted during the 
period from September to October 2011. The intervention and 
control groups were assessed at approximately three months (from 
December 2011 to January 2012) and approximately six months 
(from March to April 2012) after the baseline survey. 

Baseline characteristics 

Demographic characteristics are presented in Table 1. There 
were no significant differences in demographic characteristics 
between the intervention and control groups. In both groups, most 
participants were males, professionals, and university graduates 
with no chronic disease. 

Effects of the iCBT program on each outcome variable 

Table 2 shows the means and SDs of the outcome variables at 
baseline, three-month, and six-month follow-ups in the interven- 
tion and control groups. Table 3 shows the estimated effects of the 
iCBT program on the outcome variables based on the mixed- 
model analyses as well as the effect sizes (Cohen's d). The iCBT 
program showed a significant effect on BDI-II (t=— 1.99, p< 
0.05). The effect sizes were small. For BDI-II, the effect size was 



-0.14 (95% CI: -0.30 to 0.02) at the 3-month foUow-up and 
-0.16 (95% CI: -0.32 to 0.00) at the 6-month follow-up. 

Secondary outcomes. The iCBT program showed a signif- 
icant effect on DAS (t = -2.43, p = 0.02) and aU knowledge and 
efficacy variables (p<0.05) except for the efficacy of problem solving. 
The program showed a marginally statistically significant effect on 
K6 (t= -1.72, p = 0.09) and efficacy of problem-solving (t= 1.82, 
p = 0.07). Effect sizes for K6, DAS, and improvement of self-efficacy 
were small, while effect sizes for knowledge variables were medium. 

NNT for improving subthreshold depression. Among 
respondents at the 3-month foUow-up, 32.1% and 20.2% had a 
remission from subthreshold depression defined by BDI-II and 
K6, respectively. At the 6-month follow-up, 30.1% and 19.7% of 
respondents had a remission from subthreshold depression on 
BDI-II and K6, respectively. No significant difference was 
observed in the remission based on BDI-II between the intervention 
and control groups: relative risk (RR) of having subthreshold 
depression in the intervention group were 0.79 (p = 0.22) at the 3- 
month foUow-up and 0.77 (p = 0.20) at the 6-month foUow-up; the 
NNTs to achieve one remission from subthreshold depression were 
14 at the 3-month follow-up and 1 3 at the 6-month follow-up. The 
probability of the remission based on K6 was not significantly 
different between the groups at the 3-month foUow-up (RR= 1.02, 
p = 0.94) and was marginally significantly higher in the inter\'ention 
group than in the control group at the 6-month foUow-up 
(RR = 0.63, p = 0.06); the NNTs were -279 at the 3-month follow- 
up and 1 2 at the 6-month foUow-up. 

Subgroup analyses 

Respondents with high psychological distress. The 

subgroup analysis was conducted for participants who scored 5 
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Table 1. Baseline characteristics of participants in the intervention and control groups. 







intervention group (N = 381) 


Control group (N = 381) 


P' 




n (%) 


Average (SD) 


n (%) 


Average (SD) 




Age (years) 




38.0(9.2) 




37.2(8.8) 


0.24 


Gender 










0.33 


Male 


325(85.3) 




314(82.4) 






Female 


56(14.7) 




67(17.6) 






Marital status 










0.47 


Never married 


161(42.3) 




150(39.4) 






Married 


212(55.6) 




226(59.3) 






Divorced or bereaved 


8(2.1) 




5(1.3) 






Occupation 










0.25 


Manager 


93(24.4) 




79(20.7) 






Professional 


256(67.2) 




278(73.0) 






Clerical 


18(4.7) 




14(3.7) 






Production 


3(0.8) 




3(0.8) 






Sales 


3(0.8) 




5(1.3) 






Others 


8(2.1) 




2(0.5) 






Education 










0.59 


High school 


43(11.3) 




34(8.9) 






Some collage 


60(15.7) 




70(18.4) 






University 


245(64.3) 




242(63.5) 






Graduate school 


33(8.7) 




35(9.2) 






Chronic disease 










0.56 


Yes 


38(10.0) 




44(11.5) 






No 


343(90.0) 




337(88.5) 







*t-test or X t^st. 

doi:l 0.1 371/journal.pone.00971 67.t001 



or more on K6 at the baseline. Table 4 shows the means and SDs 
of outcome variables at baseline, 3-month, and 6-month follow- 
ups for the intervention and control groups who scored 5 or more 
on the K6 at the baseline (N = 194 for each group). Table 5 shows 
the estimated effects of the iCBT program on outcomes variables 
as well as the effect sizes (Cohen's d). The iCBT program showed a 
significant effect on BDI-II (t= -2.12, p = 0.04). The effect size for 
BDI-II was small, —0.16 at the 3-month follow-up and —0.25 at 
the 6-month foUow-up. 

The iCBT program showed a significant effect on DAS (t = 
— 2.36, p = 0.02), all knowledge variables, efficacy of stress 
management, assertive communication, and relaxation training 
(p<0.05). While the effect sizes of DAS and self-eflficacy were 
small, those for variables on knowledge were medium. 

Process evaluation. Table 6 shows the process evaluation 
indicators of the iCBT programs only for the intervention group. 
Most (89%) participants in the intervention group completed 
Lesson 1, and 65% submitted their homework after completing 
this lesson. The proportion of those who completed lessons and 
submitted homework gradually decreased during the later lessons. 
About two thirds of the intervention group completed all six 
lessons, while only a quarter of them submitted all six homework 
assignments. The average number of lessons that the respondents 
received was 4.5. The average number of homework assignments 
submitted was 2.7. Three quarters of the intervention group 
completed at least three lessons, and about half (45%) submitted at 
least three homework assignments. 



Discussion 

The present RCT examined the effects of a newly developed 
iCBT program for improving the symptoms of depression and 
other outcomes at three- and six-month foUow-ups among workers 
employed in private companies in Japan. In the total sample, the 
iCBT program showed a significant intervention effect on 
depression, as measured by BDI-II, with the effect sizes of 
— 0.16 at the six-month foUow-up. The iCBT program also 
showed a marginally statistically significant intervention effect on 
psychological distress measured by K6 and significant intervention 
effects on improving dysfunctional attitude, knowledge, and self- 
efficacy of most components of CBT. This iCBT program may 
effectively improve depressive symptoms among workers with the 
universal approach (i.e., targeting the whole working population), 
even though the effect size may be modest. 

To our knowledge, the present study first demonstrated that an 
Internet-based computerized CBT was effective in improving 
depression in a non-clinical working population. In the interven- 
tion group, BDI-II scores improved at the three-month follow-up 
and returned to the baseline level at the six-month foUow-up. In 
the control group, BDI-II scores stayed at almost the same level at 
the three-month follow-up and increased slightly by the six-month 
follow-up. This difference yielded effect sizes of —0.14 and —0.16 
on BDI-II scores at the three- and six-month foUow-ups, 
respectively. After the baseline survey, one of the two companies 
that participated in the study merged with another company. The 
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Table 6. Progress of learning in tine iCBT program among the intervention group participants: tine whole sample. 



Contents 


Completers of 
lessons 


Submitters of 
homework 


Lesson 1 Learning about stress 


340(89.2%) 


248(65.1%) 


Lesson 2 Knack for self case formulation based on CB model 


317(83.2%) 


1 93(50.7%) 


Lesson 3 Try cognitive restructuring part 1 


291 (76.4%) 


176(46.2%) 


Lesson 4 Try cognitive restructuring part 2 


272(71.4%) 


149(39.1%) 


Lesson 5 Knack for communication 


258(67.7%) 


127(33.3%) 


Lesson 6 How to solve your problem effectively 


247(64.8%) 


1 1 7(30.7%) 


All six lessons 


247(64.8%) 


93(24.4%) 


Average number of respondents who completed per lesson {proportion in to the total sample, %). 


287.5(75.5%) 




Average number of respondents who submitted homework per lesson {proportion to the total sample, %). 


168.3(44.2%) 




Average number of sessions completed per respondent. 


4.53 




Average number of homework submitted per respondent. 


2.65 




The number of respondents who completed more than 3 lessons (proportion to the total sample). 


291 (76.4%) 




The number of respondents who submitted homework more than 3 times (proportion to the total sample). 


173(45.4%) 





doi:l 0.1 371 /journal.pone.00971 67.t006 



observed increase in depression in the control group was partiy 
attributable to the increased workload associated with the 
organizational change. The current iCBT program seems to 
improve depression to some extent under severe working 
conditions. With consideration for the fact that an iCBT can be 
delivered to many workers at a low cost, this iCBT may be a 
promisingly cost-effective approach for improving depression 
among workers. The effect size of the current iCBT program for 
improving depression was small (around 0.15). Grime (2004) 
reported that the effect sizes (Cohen's d) of CCBT on depression 
among workers who recendy had stress-related absenteeism were 

— 0.25 (p = 0.04) at one month after the end of intervention and 

— 0.1 (p = 0.56) at the three-month follow-up [18]. The current 
iCBT program might be effective in improving depression among 
workers to a similar or greater extent compared to the ordinary 
CCBT program. The small effect sizes in the present study could 
be attributable to the non-clinical sample and the lower degree of 
therapist involvement in this iCBT program [16,17]. In fact, the 
iCBT program showed a better intervention effect on BDI-II, 
when the analysis was limited to those who have high depression 
score at baseline (—0.16 and —0.25 at the three- and six-month 
follow-ups, respectively), which is concordant with a previous 
meta-analysis that the effect of CBT programs in preventing major 
depressive disorder was greater for selective and indicated 
interventions than the universal one [33]. 

In the present study, the NNTs to achieve one remission from 
subthreshold depression were 14 at the 3-month follow-up and 13 
at the 6-month follow-up for BDI-II. These were —279 at the 3- 
month follow-up and 12 at the 6-month follow-up for K6. These 
figures were larger than those of the previously reported NNTs of 
iCBT for improving depression among patients with major 
depressive disorder (2 to 4), when compared with TAU or waiting 
list [32]. However, these were lower (thus better) than a NNT that 
reported a RCT using the automated e-mails containing general 
information and advice about self-help strategies for depression to 
achieve one remission from subthreshold depression (26) [38] . The 
NNTs of the present iCBT program fall between these studies of 
clinical and non-clinical populations. 

The iCBT program showed a significant intervention effect on 
dysfunctional attitude measured by the DAS in terms of 



knowledge and efficacy of most CBT components except for 
self-efTicacy of problem solving. Dysfunctional attitude is one of 
major targets of cognitive restructuring, a component of the 
current program. The present findings are consistent with previous 
ones that a CCBT program was effective in improving dysfunc- 
tional attitudes among medication-free participants with major 
depressive disorder [39], while the present study observed a larger 
effect size than that of the previous study (0.5). The effect sizes for 
knowledge were better than the one reported by a previous 
worksite-based study [40]. In addition, improved levels of 
knowledge and self-efficacy were maintained at the six-month 
follow-up. Downloadable PDF summaries of sessions of the iCBT 
program may have helped participants maintain their knowledge 
and self-efficacy. This may also be a benefit of using Manga story 
as a part of the iCBT program, while we did not systematically 
assess it. 

The process evaluation of the iCBT program indicated that 
proportions of those who completed lessons and submitted 
homework decreased for the later lessons. About two-thirds of 
the intervention group completed all six lessons, while only a 
quarter of them submitted all six homework assignments. The 
completion rates of self-help programs without clinician contact 
were generally low [13]. The average number of completed lessons 
per respondent (4.5) in this six-lesson iCBT program was very 
close to that of a previous seven-chapter self-help iCBT program 
[4 1 ,42] . The low rates of completing the lessons and submitting 
homework may have resulted in a smaller effect size in this study. 
It would be critical to increase completion rates to improve the 
effect of an iCBT program. 

Limitations 

This study has several limitations. First, participants were 
recruited from two IT companies in Japan. Most participants were 
males, working as professionals, and university graduates. They 
had their own PCs in their offices or homes. The participants were 
also supposed to have experience using a PC and studying through 
online programs. Higher education level may also help partici- 
pants learn from the iCBT program. The generalization of the 
present findings to the general working population is limited. 
Second, the rate of completing lessons and homework was low. 
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Only 93 participants submitted all homework assignments, and the 
average number of homework assignments submitted was 2.7 per 
respondent. This may weaken the findings. Third, the dropout 
rates in the present study were 29. 1 % and 28.6% at the three- and 
six-month follow-ups, respectively. In their systematic review, 
Kaltenthaler et al. (2008) reported that average CCBT dropout 
rates were 18-35% [43]. Wantland et al. (2004) reported diat an 
average dropout rate was 21% [44]. The dropout rates in the 
present study were within the range. However, the dropouts may 
cause a selection bias, particularly if the intervention group 
participants with higher levels of depression were more likely to 
quit the program. Fourth, the present study provided the 
participants in the control group with e-mails providing stress 
management tips. This may weaken the intervention elTect. Fifth, 
there was the possibility that participants in the control group 
could have information about the iCBT program from partici- 
pants in the intervention group at same workplace. This 
contamination may weaken the intervention effect. Sixth, all 
outcomes in the present study were measured by self-report, which 
may be affected by the perception of participants or situational 
factors at work. A further RCT should be conducted to examine 
whether the iCBT program is effective in a larger sample of 
workers with diverse characteristics, particularly in terms of 
occupation and education. 
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